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Background of the Invention 

1. Field of the Invention 

The present invention relates to the field of digital data processor design, 
5 specifically to the control and operation of the instruction pipeline of the processor and 
structures associated therewith. 

2. Description of Related Technology 

10 RISC (or reduced instruction set computer) processors are well knovra in the 

computing arts. RISC processors generally have the fimdamental characteristic of 
utilizing a substantially reduced instruction set as compared to non-RISC (commonly 
knovm as "CISC") processors. Typically, RISC processor machine instructions are not 
all micro-coded, but rather may be executed immediately without decoding, thereby 
15 affording significant economies in terms of processing speed. This "streamlined" 
instruction handling capability fiirthermore allows greater simplicity in the design of the 
|l processor (as compared to non-RISC devices), thereby allowing smaller silicon and 

'-^^ reduced cost of fabrication. 

RISC processors are also typically characterized by (i) load/store memory 
20 architecture (i.e., only the load and store instructions have access to memory; other 
instructions operate via internal registers within the processor); (ii) unity of processor and 
compiler; and (iii) pipelining. 

Despite their many advantages, RISC processors may be prone to significant 
delays or stalls within their pipelines. These delays stem from a variety of causes, 
25 including the design and operation of the instruction set of the processor (e.g., the use of 
multi-word and/or "breakpoint" instructions within the processor's instruction set), the 
use of non-optimized bypass logic for operand routing during the execution of certain 
types of instructions, and the non-optimized integration (or lack of integration) of the data 
cache within the pipeline. Furthermore, lack of parallelism in the operation of the 
30 pipeline can result in critical path delays which reduce performance. These aspects are 
described below in greater detail. 
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Multi-word Instructions 

Many RISC processors offer programmers the opportunity to use instructions that 
span multiple words. Some multi-word instructions permit a greater number of operands 
5 and addressing modes while others enable a wider range of immediate data values. For 
multi-word immediate data, the pipelined execution of instructions has some inherent 
limitations including, inter alia, the potential for an instruction containing long immediate 
data to be impacted by a pipeline stall before the long immediate data has been 
completely fetched from memory. This stalling of an incompletely fetched piece of data 

10 has several ramifications, one of which is that the otherwise executable instruction may 
be stalled before it is necessary to do so. This leads to increased execution time and 
overhead within the processor. Stalling of the processor due to unavailabiliy of data 
causes the processor to insert one or more additional clock cycles. During these clock 
cycles the processor can not advance additional instruction execution as a general rule. 

15 This is because the incomplete data can be considered to be a blocking fimction. This 
blocking action is to cause execution to remain pending until the data becomes available. 
For example, consider a simple add instruction that adds two quanities and places the 
result in a third location. Providing that both pieces of data are available when needed, 
the execution completes in the normal number of cycles. Now consider the case in which 

20 one of the pieces of data is not available. In this case completion of the add instruction 
must stop until the data becomes available. The consequence of this stalling action is to 
possibly delay the completion by more than the minimum necessary time. 

Breakpoint Instructions 

25 One of the usefiil RISC instructions is the "breakpoint" instruction. Chiefly for 

use during the design and implementation phases of the processor (e.g., 
softAvare/hardware integration and software debug), the breakpoint instruction causes the 
CPU to stop execution of any further instructions without some type of direct 
intervention, typically at the request of an operator. Once the breakpoint instruction has 

30 been executed by the pipeline, the CPU stops further processing until it receives some 
external signal such as an interrupt which signals to the CPU that execution should 
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resume. Breakpoint instructions typically replace or displace some other executable 
instruction which is subsequently executed upon resumption of the normal execution 
state of the CPU. 

Execution time is critical for many applications, hence minimizing so-called 
5 critical paths in the decode phase of a multi-stage pipelined CPU is an important 
consideration. Since the breakpoint instruction is a performance critical instruction during 
normal execution, the prior art practice has been to perform the breakpoint instruction 
decode and execution in the first pipeline stage of the typical four-stage pipeline (i.e., 
fetch, decode, execution, and write-back stages). Fig. 1 illustrates a typical prior art 

10 breakpoint instruction decode architecture. As shown in Fig. 1, the prior art stage 1 
configuration 100 comprises the stage 1 latch 102, instruction cache 104, instruction 
decode logic 106, instruction request address selection logic 108, the latter providing 
input to the stage 2 latches 1 10. The current program counter (pc) address value is input 
112 back to the stage 1 latch 102 for subsequent instruction fetch. Instruction decode, 

15 including decode of any breakpoint instructions, occurs v^thin the instruction decode 
logic 106. However, such decoding in the first stage places unnecessary demands on the 
speed path of ordinary instruction handling. Ordinary instructions are decoded in stage 2 
(decode) of the pipeline. This stage one decode of the breakpoint instruction places 
minimum decode requirements on the first stage that are longer than would otherwise be 

20 required without having breakpoint instruction decode occur in the first stage. This result 
is due largely to the fact that the breakpoint instruction requires time to setup and disable 
a variety of functional blocks. For example, in the ARC ™ extensible RISC processor 
architecture manufactured by the Assignee hereof, functional blocks may include 
optional mulitply-accumlate hardware, Viterbi acceleration units, and other specific 

25 hardware accelerators in addition to standard functional blocks such as an arithmetic- 
logic imit, address generator units, interrupt processors and peripheral devices. Setup for 
each of these units will depend on the exact nature of the unit. For example, a single 
cycle unit for which state information is not required for the unit to function, may require 
no specialized set up. By contrast, an operation that requires mulitple pipeline stages to 

30 complete will require assertion of signals within the pipeline to ensure .that and transitory 
resuhs are safely stored in appropriate registers. Where as other instructions are simply 
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fetched in stage 1, the breakpoint instruction requires control signals to be generated to 
most elements of the core. This results in longer netlists and hence greater delays. 

Bypass logic 

5 Bypass logic is sometimes used in RISC processors (such as the aforementioned 

ARC core) to provide additional flexibility for routing operands to a variety of input 
options. For example, as illustrated in Fig. 2, outputs of various functional units (such as 
the first and second execute stage result selection logic) are routed back to the input of 
another functional unit; e.g., decode stage bypass operand selection logic. This bypass 
10 arrangement eliminates a number of load and store operations, reduces the number of 
temporary variable locations needed during execution, and stages data in the proper 
location for iterative operations. Such bypass arrangements permit software to exploit the 
nature of pipelined instruction execution. Using the prior art bypass circuitry of Fig. 2, a 
fM program can be configured to perform pipelined iterative algorithms. One such algorithm 

m 15 is the sum-of-products for a finite series. Since the processor performs scalar operations, 
each stage of the summation is achieved by a single multiply followed by a single 
addition of the result to a sum. This principal is illustrated by the following operation: 



Sum=0 

20 For 1=1 ton do 

Sum=sum+(a(I)*b(I)); 

In a commonly used prior art CPU scheme, the value of Sum is stored in a dedicated 
general purpose register or in a memory location. Each iteration requires a memory fetch 
25 or register access operation to calculate the next summation in the series. Since the CPU 
can only perform a limited nimiber of memory or register accesses per cycle, this form 
may execute relatively slowly in comparison to a single cycle ideal for the sum-of- 
products operation (i.e., where the sum-of-products is calculated entirely within a single 
instruction cycle), or even in comparison to a non-single cycle operation where memory 
30 fetches or register accesses are not required in each iteration of the operation. 
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Data Cache Integration 

For a number of instruction types within the instruction set of the typical RISC 
processor, there in no requirement for or need to stall the pipeline. However, some other 
instruction types will require a stall to occur. The ordinary prior art method for 
5 integrating a data cache with a processor core relies on a technique that assumes that the 
worst case evaluation for stalls must be applied to even those cases where the most 
extreme case specifically does not apply. This "worst case" approach leads to an 
increased number of pipeline stalls (and/or increased duration for each stall) as well as 
increased overhead, thereby resulting ultimately in increased execution time and reduced 
10 pipeline speed. 

Fig. 3 is a logical block diagram illustrating typical prior art data cache 
integration. It assumes the cache request originates directly fi-om the pipeline rather than 

—3 

|| the load store queue. Note the presence of the bypass operand selection logic 302, the 

ye 

% control logic hazard detection logic 304, and the multi-level latch control logic 306 

IJ 1 5 structures within the second (E2) execution stage . 

Fig. 3a illustrates the operation of the typical prior art data cache structure of Fig. 
3 in the context of an exemplary load (Ld), move (Mov), and add (Add) instruction 
sequence. The exemplary instruction sequence is as follows: 



20 Ldr0,[rl,4] 

Mov r5,r4 ;independent of the load 
Add r8,r0,r9 ;dependent on first load 



First, in step 350, the Load (Ld) is requested. The Mov is then requested in step 
25 352. In step 354, the Add is requested. The Ld operation begins in step 356. Next, the 
Mov operation begins in step 358. The cache misses. Accordingly, the Add is then 
prevented from moving. 

In step 360, the Mov continues to flow down the pipeline. In step 362, the Add 
moves down the pipeline in response to the Load operation completing. The pipeline then 
30 flows with no stalls (steps 364, 366, and 368). 

Note that in the foregoing example, the Add instruction is prevented firom moving 
from the decode stage of the pipeline to the first execute stage (El) for several cycles. 
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This negatively impacts pipeline performance by slowing the execution of the Add 
instruction. 

Pipeline Parallelism 

5 Often in prior art processor systems, the instruction cache pipeline integration is 

far from optimal. This results in many cases from the core effectively making the cache 
pipeline stages 0 and 1 dependent on each other. This can be seen diagrammatically in 
Fig. 4, wherein the pipeline control 402, instruction decode 404, nextpc selection 406, 
and instruction cache address selection 408, are disposed in the instruction fetch stage 

10 412 of the pipeline. The critical path of this non-optimized pipeline 400 allows the 
control path of the processor to be influenced by a slow signal/data path. Accordingly the 
slow data path must be removed if the performance of the core is to be improved. For 
example, in most core build instances, the prior art approach means the instruction fetch 
pipeline stage has an unequal duration to the other pipeline stages, and in general 

15 becomes the limiting factor in processor performance since it limits the minimum clock 
period. 

Fig. 4a is a block diagram of components and instruction flow within the non- 
optimized processor design of Fig. 4. As illustrated in Fig. 4a, the slow signal/data path 
influences the control path for the pipeline 400. 

20 Based on the foregoing, there is a need for an improved methods and apparatus 

for enhancing pipeline operation, including reducing stalls and delays in CPU execution. 
Ideally, several aspects of pipeline operation would be optimized by such improved 
method and apparatus, including (i) handling of multi-word instructions and immediate 
data, such as in the calculation of such scalar quantities with a reduced number of 

25 memory fetches or register accesses; (ii) use of breakpoint instructions; (iii) bypass logic 
arrangement, (iv) data cache operation/integration, and (v) increased parallelism within 
the pipeline. Additionally, such improved apparatus and method would be readily 
adapted to existing processor designs and architectures, thereby minimizing the work 
necessary to integrate such fianctionality, as well as the impact on the processor design as 

30 a whole. 
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Summary of the Invention 
The foregoing needs are satisfied by providing an improved method and apparatus 
for enhanced performance in a pipelined processor. 
5 hi a first aspect of the invention, a method and apparatus for avoiding the stalling of 

long immediate data instructions, so that processor performance is maximized, is disclosed. 
The invention results in not enabling the host to halt the core before an instruction with long 
immediate values in the decode stage of the pipeline has merged, thereby advantageously 
making the instructions containing long immediate data "non-stallable" on the boxmdary 
10 between the instruction opcode and the immediate data. Consequently the instruction 
containing long immediate data is treated as if the CPU was wider in word wddth for that 
instruction only. The method generally comprises providing a first instruction word; 
providing a second instruction word; and defming a single large instruction word 
comprising the first and second instruction words; wherein the single large instruction word 
111 15 is processed as a single instruction within the processor's pipeline, thereby reducing pipeline 
% delays. 

In a second aspect of the invention, an improved apparatus for decoding and 
Q executing breakpoint instructions, so that processor pipeline performance is maximized, is 

^ disclosed. In one exemplary embodiment, the apparatus comprises a pipeline arrangement 

M 20 with instruction decode logic operatively located within the second stage (e.g., decode stage) 
of the pipeline, thereby facilitating breakpoint instruction decode in the second stage versus 
the first stage as in prior art systems. Such decode in the second stage removes several 
critical "blockages" within the pipeUne, and enhances execution speed by increasing 
parallelism therein. 

25 In a third aspect of the invention, an improved method for decoding and executing 

breakpoint instructions, so that processor pipeline performance is maximized, is disclosed. 
Generally, the method comprises providing a pipeline having at least first, second, and third 
stages; providing a breakpoint instruction word, the breakpoint instruction word resulting in 
a stall of the pipeline when executed; inserting the breakpoint instruction word into the first 
30 stage of the pipeline; and delaying decode of the breakpoint instruction word until the 
second stage of the pipeline. In one exemplary embodiment, the pipeline is a four stage 
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pipeline having fetch, decode, execution, and write-back stages, and decode of the 
breakpoint instruction is delayed until the decode stage of the processor. Additionally, to 
support the decoding the breakpoint instruction in the decode stage, the method further 
comprises changing the program counter (pc) from the current value to a breakpoint pc 
5 value. 

In a fourth aspect of the invention, an improved method of debugging a processor 
design is disclosed. The method generally comprises providing a processor hardware 
design having a multi-stage pipeline; providing an instruction set including at least one 
breakpoint instruction adapted for use with the processor hardware design; running at 
10 least a portion of the instruction set (including the breakpoint instruction) on the 
processor design during debug; decoding the at least one breakpoint instruction at the 
second stage of the pipeline; changing the program counter (pc) from the current value to 
a breakpoint pc value; executing the breakpoint instruction on order to halt processor 
operation; and debugging the instruction set or hardware/instruction set integration while 
1 5 the processor is halted. 

In a fifth aspect of the invention, an apparatus for bypassing various components 
and registers within a processor so as to maximize pipeline performance is disclosed. In 
^1 one embodiment, the apparatus comprises an improved logical arrangement employing a 

special multi-function register having a selectable "bypass mode"; when in bypass mode, 
20 the multi-function register is used to retain the result of a multi-cycle scalar operation (e.g., 
summation in a sum-of-products calculation), and present this result as a value to be selected 
from by a subsequent instruction. In this fashion, memory accesses to obtain such 
summation are substantially obviated, and the pipeline accordingly operates at a higher 
speed due to elimination of the delays associated with the obviated memory accesses. 
25 In a sixth aspect of the invention, a method for bypassing various components and 

registers within a processor so as to maximize processor performance is disclosed. In one 
embodiment, the method comprises providing a multi-function register; defining a bypass 
mode for the register, wherein the register maintains the result of a multi-cycle scalar 
operation therein during such bypass mode; performing a scalar operation a first time; 
30 storing the result of the operation in the register in bypass mode; obtaining the result of 
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the first operation directly from the register, and performing a scalar operation a second 
time using the resuh of the first operation obtained from the register. 

In an seventh aspect of the invention, improved methods for increasing pipeline 
performance and efficiency by decoupling certain signals, and allowing an existing pipeline 
5 configuration to reveal more parallelism, are disclosed. The dataword fetch (e.g., ifetch) 
signal, which indicates the need to fetch instruction opcode/data from memory at the 
location being clocked into the program counter (pc) at the end of the current cycle, is made 
independent of the qualifying (validity) signal (e.g., ivalid). Additionally, the next program 
counter value signal (e.g., next_pc) is made independent of the data word supplied by the 
10 memory controller (e.g., pliw) and ivalid. The hazard detection logic and control logic of 
the pipeline is further made independent of ivalid; i.e., the stage 1, stage 2, and stage 3 
enables (enl, en2, en3) are decoupled from the ivalid (and pliw) signals, thereby decoupling 
pipeline movement. So-called "structural stalls" are further utilized when a slow functional 
unit, or operand fetch in the case of the xy memory extension, generates the next program 
1 5 counter signal (next_pc). The jump instruction of the processor instruction set is also moved 
from stage 2 to 3, independent of ivalid. In this case, the jump address is held if the delay 
slot misses the cache and link. Additionally, delay slot instmctions are not separated from 
their associated jump instruction. 

In an eighth aspect of the invention, an improved data cache apparatus usefiil within 
ill 20 a pipelined processor is disclosed. The apparatus generally comprises logic which allows the 
g'" pipeline to advance one stage ahead of the cache. Furthermore, rather than assuming that the 

pipeline will need to be stalled under all circumstances as in prior art pipeline control logic, 
the apparatus of the present allows the pipeline to move ahead of the cache, and only stalls 
when a required data word is not provided (or other such condition necessitating a stall). 
25 Such conditional "latenf ' stalls enhance pipeline performance over the prior art 
configurations by eliminating conditions where stalls are unnecessarily invoked. In one 
exemplary embodiment, the pipelined processor comprises an extensible RISC-based 
processor, and the logic comprises (i) bypass operand selection logic disposed in the 
execution stage of the pipeline, and (ii) a multi-function register architecture. 
30 In a ninth aspect of the invention, an improved method of reducing pipeline delays 

due to stalling using "latent" stalls is disclosed. The method generally comprises providing 
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a processor having an instruction set and multistage pipeline; adapting the processor pipeline 
to move at least one stage ahead of the data cache, thereby assuming a data cache hit; 
detecting the presence of at least one required data word; and stalling the pipeline only when 
the required data word is not present. 
5 In a tenth aspect of the invention, an improved processor architecture utilizing one 

or more of the foregoing improvements including "atomic" instruction words, 
improved bypass logic, delayed breakpoint instruction decode, improved data cache 
architecture, and pipeline "decoupling" enhancements, is disclosed. In one exemplary 
embodiment, the processor comprises a reduced instruction set computer (RISC) having a 

10 four stage pipeline comprising instruction fetch, decode, execute, and writeback stages, 
and "latent stall" data cache architecture which allows the pipeline to advance one stage 
ahead of the cache. In another embodiment, the processor further includes an instruction 
set comprising at least one breakpoint instruction, the decoding of the breakpoint 
instruction being accomplished within stage 2 of the pipeline. The processor is also 

15 optionally configured with a multi-function register in a bypass configuration such that 
the result of one iteration of an iterative calculation is provided directly as an operand for 
subsequent iterations. 

Brief Description of the Drawings 
Fig. 1 is functional block diagram of a prior art pipelined processor breakpoint 
20 instruction decode architecture (stage 1) illustrating the relationship between the 
instruction cache, instruction decode logic, and instruction request address selection 
logic. 

Fig. 2 is block diagram of a prior art processor bypass logic architecture 
illustrating the relationship of the bypass logic to the single- and multi-cycle functional 
25 units and registers. 

Fig. 3 is functional block diagram of a prior art pipelined processor data cache 
architecture illustrating the relationship between the data cache and associated execution 
stage logic. 

Fig. 3a is graphical representation of pipeline movement within a typical prior art 
30 processor pipeline architecture. 
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Fig. 4 is block diagram illustrating a typical non-optimized prior art processor 
pipeline architecture and the relationship between various instructions and functional 
entities within the pipeline logic. 

Fig. 4a is a block diagram of components and instruction flow within the non- 
5 optimized prior art processor design of Fig. 4. 

Fig. 5 is logical flow diagram illustrating one embodiment of the long instruction 
word long immediate (limm) merge logic of the invention. 

Fig. 6 is a block diagram of one embodiment of the modified pipeline architecture 
and related functionalities according to the present invention, illustrating the enhanced 
1 0 path independence and parallelism thereof. 

Fig. 7 is a functional block diagram of one exemplary embodiment of the pipeline 
logic arrangement of the invention, illustrating the decoupling of the ivalid and pliw 
signals firom the various other components of the pipeline logic. 

Fig. 8 is functional block diagram of one embodiment of the breakpoint 
111 15 instruction decode architecture (stage 1) of the present invention, illustrating the 
relationship between the instruction cache, instruction decode logic, and instruction 
request address selection logic. 
Q Fig. 8a is a graphical representation of the movement of the pipeline of an 

^ exemplary processor incorporating the improved breakpoint instruction logic of the 

^^f 20 invention, wherein a breakpoint instruction located with in a delay slot. 
Ml Fig. 8b is a graphical representation of pipeline movement wherein a breakpoint 

instruction normally handled within the pipeline when a delay slot is not present. 

Fig. 8c is a graphical representation of pipeline movement during stalled jump 
and branch operation according to the present invention. 
25 Fig. 9 is block diagram of one embodiment of the improved bypass logic 

architecture of the present invention, illustrating the use of a multi-function register 
within the execute stage of the pipeline logic between the bypass operand selection logic 
and the single- and multi-cycle functional units. 

Fig. 10 is a logical flow diagram illustrating one embodiment of the method of 
30 utilizing bypass logic to maximize processor performance during iterative calculations 
(such as sum-of products) according to the invention. 
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Fig. 1 1 is a block diagram illustrating one exemplary embodiment of the modified 
data cache structure of the present invention. 

Fig. 11a is a graphical representation of pipeline movement in an exemplary 
processor incorporating the improved data cache integration according to the present 
invention. 

Fig. 12 is logical flow diagram illustrating the one exemplary embodiment of the 
method of enhancing the performance of a pipelined processor design according to the 
invention. 

Fig. 13 is a logical flow diagram illustrating the generalized methodology of 
synthesizing processor logic using a hardware description language (HDL), the 
synthesized logic incorporating the pipeline performance enhancements of the present 
invention. 

Fig. 14 is a block diagram of an exemplary RISC pipelined processor design 
incorporating various of the pipeline performance enhancements of the present invention. 

Fig. 15 is a functional block diagram of one exemplary embodiment of a 
computer system useful for synthesizing gate logic implementing the aforementioned 
pipeline performance enhancements within a digital processor device. 

Detailed Description 
Reference is now made to the drawings wherein like numerals refer to like parts 
throughout. 

As used herein, the term "processor" is meant to include any integrated circuit or 
other electronic device capable of performing an operation on at least one instruction 
word including, without limitation, reduced instruction set core (RISC) processors such 
as the ARC^^ user-configurable core manufactured by the Assignee hereof, central 
processing units (CPUs), and digital signal processors (DSPs). The hardware of such 
devices may be integrated onto a single piece of silicon ("die"), or distributed among two 
or more die. Furthermore, various functional aspects of the processor may be 
implemented solely as software or firmware associated with the processor. 

Additionally, it will be recognized by those of ordinary skill in the art that the 
term "stage" as used herein refers to various successive stages within a pipelined 
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processor; i.e., stage 1 refers to the first pipelined stage, stage 2 to the second pipelined 
stage, and so forth. 

It is also noted that while the following description is cast in terms of VHSIC 
hardware description language (VHDL), other hardware description languages such as 
5 Verilog® may be used to describe various embodiments of the invention with equal 
success. Furthermore, while an exemplary Synopsys® synthesis engine such as the 
Design Compiler 2000.05 (DCOO) is used to synthesize the various embodiments set forth 
herein, other synthesis engines such as Buildgates® available from, inter alia. Cadence 
Design Systems, Inc., may be used. IEEE std. 1076.3-1997, IEEE Standard VHDL 
10 Synthesis Packages, describe an industry-accepted language for specifying a Hardware 
Definition Language-based design and the synthesis capabilities that may be expected to 
be available to one of ordinary skill in the art. 

Lastly, it is noted that as used in this disclosure, the terms "breakpoint" and 
"breakpoint instruction" refer generally that class of processor instructions which result 
15 in an interrupt or halting of at least a portion of the execution or processing of 
instructions within the pipeline or associated logic imits of a digital processor. As 
discussed in greater detail below, one such instruction comprises the "Brkx" class of 
instructions associated with the ARC™ extensible RISC processor previously referenced; 
however, it will be recognized that any number of different instructions meeting the 



J^f 20 aforementioned criteria may benefit firom the methodology of the present invention 



It will be noted that while the various methodologies of the invention are 
described herein in terms of a particular sequence of steps, such descriptions are only 
exemplary of the broader methods. Accordingly, the sequence of performace of such 
steps may in many cases be permuted, and/or additional steps added. Other steps may be 
25 optional. All such variations are considered to fall v^thin the scope of the claims 
appended hereto. 

Overview 

Pipelined CPU instruction decode and execution is a common method of 
providing performance enhancements for CPU designs. Many CPU designs offer 
30 programmers the opportunity to use instructions that span multiple words. Some multi- 
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word instructions permit a greater number of operands and addressing modes, while 
others enable a wider range of immediate data values. For multi-word immediate data, 
pipelined execution of instructions has some built-in limitations. As previously discussed, 
one of these limitations is the potential for an instruction containing long immediate data 
5 to be impacted by a pipeline stall before the long immediate data has been completely 
fetched from memory. This stalling of an incompletely fetched piece of data has several 
ramifications, one of which is that the otherwise executable instruction may be stalled 
before it is necessary. This leads to increased execution time and overhead, thereby 
reducing processor performance. 

10 The present invention provides, inter alia, a way to avoid the stalling of long 

immediate data instructions so that performance is maximized. The invention further 
eliminates a critical path delay in a typical pipelined CPU by treating certain multi-word 
long immediate data instructions as a larger or "atomic" multi-word oversized instruction. 
These larger instructions are multi-word format instructions such as those employing long 

15 immediate data. Typical instruction types for the oversized instructions disclosed herein 
include "load immediate" and "jimip" type instructions. 

Processor instruction execution time is critical for many applications; therefore, 
minimizing so-called "critical paths" within the decode phase of a multi-stage pipelined 
processor is also an important consideration. One approach to improving performance of the 

20 CPU in all cases is removing the speed path limitations. The present invention accomplishes 
removal of such path limitations by, inter aha, reducing the number of critical path delays in 
the control logic associated with instruction fetch and decode, including decode of 
breakpoint instructions used during processes such as debug. By moving the breakpoint 
instruction decode from stage 1 (as in the prior art) to stage 2, the present invention 

25 eliminates the speed path constraint imposed by the breakpoint instruction; stage 1 
instruction word decoding is advantageously removed from the critical path. 

Delays in the pipeline are further reduced using the methods of the present invention 
through modifications to the pipeline hazard detection and control logic (and register 
structure), which effectively reveal more parallelism in the pipeline. Pipelining of operations 

30 which span multiple cycles is also utilized to increase parallelism. 
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The present invention further advantageously permits the data cache to be integrated 
into the processor core in a manner that allows the pipeline to advance one stage ahead of 
the data cache, hi the particular case of the aforementioned ARC^"^ extensible RISC 
processor manufactured by the Assignee hereof, since the valid signal for returning loads 
5 (i.e., "Idvalid") does not necessarily influence pipeline movement, it can be assumed that the 
data cache will "hit" (i.e., contain the appropriate data value when accessed). Such cache hit 
allows the pipeline to move on to conduct further processing. If this assumption is wrong, 
and the requested data word is needed by an execution unit in stage 3, the pipeline can then 
be stalled. This "latent stall" approach improves pipeline performance significantly, since 
1 0 stalls within the pipeline due to cache "misses" are invoked only on an as-needed basis. 

Appendix I provides detailed logic equations in HDL format detailing the method of 
the present invention in the context of the aforementioned ARC^^ extensible RISC 
fl processor core. It will be recognized, however, that the logic equations of Appendix I (and 

those specifically described in greater detail below) are exemplary, and merely illustrative of 
15 the broader concepts of the invention. 

While each of the improvement elements referenced above may be used in isolation, 
it should be recognized that these improvements advantageously may be used in 
combination. In particular, the combination of an instruction memory cache with the bypass 
logic will serve to maximize instruction execution rates. Likev^se, the use of a data cache 
20 minimizes data related processor stalls. Combining the breakpoint function with memory 
caches mitigates the impact of the breakpoint fimction. Selection of combinations of these 
functions compromises complexity with performance. It will be appreciated that the choice 
of functions may be determined by a number of factors including the end application for 
which the processor is designed. 

25 

''Atomic Instructions 

The invention in one aspect prevents enabling the host to halt the core while an 
instruction with long immediate values in stage 2 has not merged. This results in making 
the instructions containing long immediate data non-stallable on the boundary between 
30 the instruction opcode and the immediate data. Consequently the instruction containing 
long immediate data is treated as if the CPU was wider in word width for that instruction 
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only. The foregoing functionality is specifically accomplished within the ARC™ core by 
connecting the holci_host value to the instruction merge logic, i.e. p2_merge_valid_r and 
p21imm. Fig. 5 illustrates one exemplary embodiment of the logical flow of this 
arrangement. The method 500 generally comprises first determining whether an 
5 instruction with long immediate (limm) data is present (step 502); if so the core merge 
logic is examined to determine whether merging in stage 2 of the pipeline has occurred 
(step 504). If merging has occurred (step 506), the halt signal to the core is enabled (i.e., 
"halt permissive" per step 508), thereby allowing the core to be halted at any time upon 
initiation by the host. If merging has not occurred per step 506, then the core waits one 
10 instruction cycle (step 510) and then re-examines the merge logic to determine if merging 
has occurred. Accordingly, long immediate instructions cannot be stalled unless merging 
has occurred, which effectively precludes stalling on the instruction/immediate data word 
=y boundary. 

^ Appendix I hereto provides detailed logic equations (rendered in hardware 

ni 15 description language) of one exemplary embodiment of the functionality of Fig. 5, 
specifically adapted for the aforementioned ARC core manufactured by the Assignee 
hereof 
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Enhanced Parallelism 



20 As previously shown in Fig. 4, the speed of each pipeline stage in the non- 

optimized prior art pipeline structure is bound by the slowest stage. Some functional 
blocks within the instruction fetch pipeline stage of the processor are not optimally 
placed within the pipeline structure. 

Fig. 6 illustrates the impact on pipeline operation of the methods of enhanced 

25 parallelism according to the present invention. The dark shaded blocks 602, 604, 606, 
608, 610 show areas of modification. These modifications, when implemented, produce 
significant improvements to the maximum speed of the core. Specifically, full pipelining 
of the blocks as in the present embodiment allows them to overlap with other blocks, and 
hence their propagation delay is effectively hidden. It is noted that these modifications do 

30 not change the instruction set architecture (ISA) in any way, but do produce slight 
changes in the timing of 64-bit instructions, instructions in delay slots, and jump indirect 
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instructions which could need to bypass data words from slow execution units to generate 
nextpc. 

Fig. 7 is a block diagram of the modified pipeline architecture 700 according to 
one embodiment of the invention. In the modified architecture of Fig. 7, the slow cache 
5 path does not influence the control path (unlike that of the prior art approach of Figs. 4 
and 4d), thereby reducing processor pipeline delays. Specifically, the ivalid signal 702 
produced by the data word selection and cache "hit" evaluation logic 704 is latched into 
the first stage latch 706. Additionally, the long immediate instruction word (pliw) signal 
708 resuhing from the logic 704 is latched into the first stage latch 706. 
10 Using the arrangement of Fig, 7, the dataword fetch (ifetch) signal 717, which 

indicates the need to fetch instruction opcode or data from memory at the location being 
clocked into the program counter (pc) at the end of the current cycle, is decoupled or 
made independent of the ivalid signal 702. This results in the instruction cache 709 
ignoring the ifetch signal 717 (except when a cache invalidate is requested, or on start- 
15 up). 

^1 Additionally, due to the latching arrangement of Fig. 7, the next program counter 

signal (nextpc) 716, which is indicative of the dataword address, is made independent of 
the word supplied by the memory controller (pliw) 708 and ivalid 702. Using this 
Tl approach, nextpc is only valid when ifetch 717 is true (i.e., required opcode or dataword 

20 needs to be fetched by the memory controller) and ivalid is true (apart from start-up, or 
SI after an ivalidate). Note that the critical path signal or unnecessarily slow signal is readily 

revealed when the "nextpc" path 416 is removed (dotted flow lines of Fig. 4a). 

The hazard detection logic 722 and pipeline control logic 724 is further made 
independent of the ivalid signal 702; i.e., the stage 1, stage 2, and stage 3 enables (enl 
25 727, en2 729, and en3 730, respectively) are decoupled from the ivalid signal 702. 
Therefore, influence on pipeUne movement by ivalid 702 is advantageously avoided. 

Instructions with long immediate data are merged in stage 2. This merge at stage 
2 is a consequence of the foregoing independence of the hazard logic 722 and control 
logic 724 from ivalid 702; since these instructions wdth long immediate data are made up 
30 of multiple multi-bit words (e.g., two 32-bit data words), two accesses of the instruction 
cache 709 are needed. That is, an instruction with a long immediate should not move to 
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stage 3 until both the instruction and long immediate data are available in stage 2 of the 
pipeline. This requirement is also imposed for jump instructions with long immediate 
data values. In current practice, the instruction opcode comes from stage 2 and the long 
immediate data from stage 1 when a long immediate instruction is issued, that is, when 
the instruction moves to stage 3. 

The present invention fiirther utilizes "structural stalls" to enhance pipeline 
performance such as when a slow functional unit (or operand fetch in the case of the xy 
memory extension) generates nextpc 716 (that is, jump register indirect instructions, j 
[rx], where the value of rx can be bypassed from a fimctional unit). As used herein, the 
term "structural stalls" refers to stall requirements that are defined by limitations inherent 
in the fimctional unit. One example of a structural stall is the operand fetch associated 
with the XY memory extension of the ARC processor. This approach advantageously 
allows slow forwarding paths to be removed, by prematurely stalling the impeding 
operation. For example, new program counter (pc) values are rarely generated by 
multipliers; if such values are generated by the multiplier, they can result in a cycle delay 
that is a 1 cycle stall or bubble, and allow next_pc to be obtained from the register file 
731. In general, the present invention exploits the stall that is inherent in generating a 
next PC address which is not sequentially linear in the address space. This occurs when a 
new PC value is calculated by an instruction such as jump. In addition, it may be 
appreciated that certain instruction sets permit arithmetic and logic operations to directly 
a new PC. Such computations also introduce a structural stall which under some 
circumstances may be exploited to continue operation of the CPU. 

In addition to the foregoing, the present invention further removes or optimizes 
remaining critical paths within the processor using selective pipelining of operations. 
Specifically, paths that can be extended over more than one processor cycle with no 
processor performance loss can be selectively pipelined if desired. As an example, the 
process of (i) activating sleep mode, (ii) stopping the core, and (iii) detecting a breakpoint 
instruction, does not need to be performed in a single cycle, and accordingly is a 
candidate for such pipelining. 
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Breakpoint Instruction Decode Architecture 

Referring now to Fig. 8, one embodiment of the modified breakpoint architecture 
of the invention is described. As illustrated in Fig. 8, the architecture 800 comprises 
generally a first stage latch (register) 801, an instruction cache 802, instruction request 
5 selection logic 804, an intermediate (e.g., second stage) latch 806, and instruction decode 
logic 808. The instruction cache 802 stores or caches instructions received from the latch 
801 which are to be decoded by the instruction decode logic 808, thereby obviating at 
least some program memory accesses. The design and operation of instruction (program) 
caches is well known in the art, and accordingly will not be described further here. The 
10 instruction word(s) stored within the instruction cache 802 is/are provided to the 
instruction request address selection logic 804, which utilizes the program counter 
(nextpc) register to identify the next instruction to be fetched, based on data 810 (e.g., 16- 

■jf bit word) from the instruction decode logic 808 and the current instruction word. This 

'•hi 

ISI data includes such information as condition codes and other instruction state information, 

% 15 assembled into a logical collection of information which is not necessarily physically 

assembled. For example, a condition code by itself may select an alternative instruction 
ill ot be fetched. The address from which the instruction is to be fetched may be identified 

by a ariety of words such as the contents of a register or a data word from memory. The 
'-jJ instruction word provided to the instruction request logic 804 is then passed to the 

III 20 intermediate latch 806, and read out of that latch on the next successive clock cycle by 

the instruction decode logic 808. 

Hence, in the case of a breakpoint instruction, the decode of the instruction (and 

its subsequent execution) in the present embodiment is delayed until stage 2 of the 

pipeline. This is in contrast to the prior art decode arrangement (Fig. 1), wherein the 
25 instruction decode logic 808 is disposed immediately following the instruction cache 802, 

thereby providing for immediate decode of a breakpoint instruction after it is moved out 

of the instruction cache 802 (i.e., in the first stage), which places the decode operation in 

the critical path. 

Additionally, in order to move the breakpoint instruction decode to stage 2 as 
30 described above, the program counter (pc) of the present embodiment is changed from the 
current value to the breakpoint pc value through a simple assignment. This modification is 
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required based on timing considerations; specifically, by the time the breakpoint instruction 
is decoded, the pc has already been updated to point to the next instruction. Hence, the pc 
value must be "reset'* back to the breakpoint instruction value to account for this decoding 
delay. 

The following examples illustrate the operation of the modified breakpoint 
instruction decode architecture of the present invention in detail. 

Example 1- Delay Slot 

Fig. 8a and the discussion following hereafter illustrate how a breakpoint 
instruction located with in a delay slot is processed using the present invention. As is well 
known in the digital processing arts, delay slots are used in conjunction with certain 
instruction types for including an instruction which is executed during execution of the 
parent instruction. For example, a "jump delay slot" is often used to refer to the slot 
within a pipeline subsequent to a branching or jump instruction being decoded. The 
instruction after the branch (or load) is executed while awaiting completion of the 
branch/load instruction. It will be recognized that while the example of Fig. 8a is cast in 
terms of a breakpoint instruction disposed in the delay slot after a "Jump To" instruction, 
other applications of delay slots may be used, whether alone or in conjunction with other 
instruction types, consistent with the present invention. 

Note that as used herein, the nomenclature " <name><Address>" refers to the instruction 
name at a given address. For example, "J.dA" refers to a "Jump To" instruction at address 
A. 

In step 820 of Fig. 8a, an instruction (e.g, "Jump To" at address A, or "J.dA") is 
requested. Next, the breakpoint instruction at address B (Brke) is requested in step 822. 
In step 824, the target address at address C (Targetc) is requested. The target address is 
saved in the second operand register or the long immediate register of the processor in the 
illustrated example. The instruction in the fetch stage is killed. 

Next, in step 826, the breakpoint instruction of step 822 above (Brke) is decoded. The 
current pc value is updated with the value of lastpc, the address of Brke rather than the 
address of Target^ as previously described. An extra state is also implemented in the 
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present embodiment to indicate (i) that a 'breakpoint restart' is needed, and (ii) if the 
breakpoint instruction was disposed in a delay slot (which in the present example it is). 

In step 828, the "Jump To" instruction J.dA completes, and once all other multi-cycle 
instructions have completed, the core is halted, reporting a break instruction. Next, in step 
830, the host takes control and changes Brke to Adds (for example, by a "write" to main 
memory). The host then invalidates the memory mapping of address B by either 
invalidating the entire cache or invalidating the associated cache line. The host then starts 
the core running. 

After the core is running, the add instruction at address B, Adds, is fetched using the 
current program coimter value (currentpc) in step 832. Then, in step 834, the target value 
at address C (Targetc) is requested, using the target address from stage 3 of the pipeline. 
The current program counter value (currentpc) is set equal to the Targetc address. In step 
836, Target2c is requested. Lastly, in step 838, the Target3c is requested. 

Note that in the example of Fig. 8a above, the breakpoint instruction execution is 
complicated by the presence of a delay slot. This requires the processor to restart 
operation at the delay slot after the completion of the breakpoint instruction. The 
instruction at the delay slot address is then executed, followed by the instruction at the 
address specified by the jump instruction. The program continues from the target address. 

Example 2 - Non-delay Slot Breakpoint Use 

Fig. 8b and subsequent discussion illustrate how a breakpoint instruction is 
normally handled within the pipeline when a delay slot is not present. 

First, in step 840, an add at address A (AddA) is requested. A breakpoint 
instruction at address B (Brke) is then requested in step 842. A "move" at address C 
(Move) is next requested in step 844. The instruction in the fetch stage (stage 1) is killed. 
The breakpoint instruction (Brke) is next decoded in step 846. The current pc value is 
updated with the value of lastpc, i.e., the address of Brke rather than the address of the 
instruction following Move. Move is killed. 
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Next, in step 848, the AddA instruction completes, and once all other multi cycle 
instructions (including delayed loads) have completed, the processor is halted, reporting a 
break instruction. The host then takes control in step 850, changing Brke to Adde (such 
as by a write to main memory). The host then invalidates the memory mapping of 
address B by either invalidating the entire cache or invalidating the associated cache line. 
The host then starts the core running again per step 850. 

In step 852, the add instruction at address B (Adds) is fetched using the current 
address in the program coimter (currentpc). A move at address C (Move) is again 
requested in step 854. Mov2c is then requested in step 856, and lastly Mov3c is requested 
in step 858. 

Example 3 - Stalled Jump and Branches 

Referring now to Fig. 8c, in step 860, the jump instruction J.dA is requested. The 
breakpoint instruction (Brke) is next requested in step 862. Targetc is next requested in 
step 864. The target address is saved in the second operand register or the long immediate 
register in the illustrated embodiment, although it will be recognized that other storage 
locations may be utilized. 

The breakpoint instruction (Brke) is next decoded in step 866. Current pc is updated 
with the value of lastpc, the address of Brke rather than the address of Targetc- As with 
the example of Fig. 8b above, an extra state is added to indicate (i) that a 'breakpoint 
restart' is needed, and (ii) if the breakpoint instruction was in a delay slot. The "Jump 
To" instruction J.dA is stalled in stage 3 since, inter alia^ it may be a link jump. Once all 
other multi cycle instructions have completed the core is halted, and a break instruction 
reported. In step 868, the host takes control and changes Brke to Targetc. The host then 
invalidates the memory mapping of address B by either invalidating the entire cache or 
invalidating the associated cache line. The host then starts the core running in step 870. 

The add instruction at address B (Adds) is next fetched using the address of the 
currentpc. In step 874, Targetc is requested, using the target address from stage 3 
(execute) of the pipeline. The currentpc address is set equal to the Targetc address. 
Target2c is then requested per step 876, and Target3c is requested per step 878. 
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Note that in the example of Fig. 8c, the breakpoint instruction is disposed in a delay 
slot, but the processor pipeline is stalled. The breakpoint instruction is held for execution 
until the multi-cycle instructions have completed executing. This limitation is imposed to 
prevent leaving the core in a state of partial completion of a multi-cycle instruction 
5 during the breakpoint instruction execution. 

Bypass Logic 

Referring nov^ to Fig. 9, the bypass logic 900 of the present invention comprises 
bypass operand selection logic 902, one or more single cycle functional units 904, one or 
10 more multi-cycle functional units 906, result selection logic 908 operatively coupled to 
the output of the single cycle functional units, a register 910 coupled to the output of the 
result selection logic 908 and the multi-cycle functional units 906, and more multi-cycle 
]% functional units 912 and result selection logic 914 coupled sequentially to the output of 

\fy the register 910 as part of the second execute stage 920. A second register 918 is also 

i|i 15 coupled to the output of the result selection logic 914. A return path 922 connects the 

-•sis. 

output of the second stage result selection logic 914 to the input of a third "multi- 
fl^ function" register 924, the latter providing input to aforementioned bypass operand 

Q selection logic 902. A similar return path 926 is provided from the output of the first 

J stage result selection logic 908 to the input of the third register 924. As used herein, the 

Wi 20 term "single-cycle" refers to instructions v^hich have only one execute stage, while the 
y[ term "multi-cycle" refers to instructions having two or more execute stages. Of particular 

interest are the instructions that are multi-cycle by virtue of a need to load long 
immediate data. These instructions are formed, e.g., by two sequential instruction words 
in the instruction memory. The first of the words generally includes the op-code for the 
25 instruction, and potentially part of the long immediate data. The second word is made up 
of all (or the remainder) of the long immediate data. 

By employing the bypass arrangement of Fig. 9, the present invention replaces the 
register or memory location used in prior art systems such as that illustrated in Fig. 2 v^th 
a special register 924 that serves multiple purposes. When used in a "bypass" mode, the 
30 special register 924 retains the sunmiation result and presents the summation result as a 
value to be selected from by an instruction. The result is a software loop that can execute 
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nearly as fast as custom-built hardware. The execution pipeline fills with the instructions 
to perform the sum of products operation and the bypass logic permits the functional 
units to operate at peak speed without any additional addressing of memory. Other 
functions of this register 924 (in addition to the aforementioned "bypass" mode 
5 operation) include (i) latching the source operands to permit fully static operation, and (ii) 
providing a centralized location for synchronization signal/data movement. 

As can be seen from Fig. 9, the duration for single cycle instructions in the 
present embodiment of the pipeline is unchanged as compared to that for the prior art 
arrangement (Fig. 2); however, multi-cycle instructions benefit from the pipeline 

10 arrangement of the present invention by effectively removing the bypass logic during the 
last cycle of the multi-cycle execution. Note that in the case of single cycle instructions, 
the bypass logic is not on the critical path because the datapath is sequenced to permit 
delay-free operation. By moving the latches (register) 924 to the front of the datapath as 
in Fig. 9, the second and subsequent cycles required for instruction execution are 

15 provided with additional time. This additional time comes fi'om the fact that there are no 
additional decoding delays associated with the logic for the functional units and operand 
selection, and because the register 924 may be clocked by a later pipeline stage. Since a 
later stage clock signal may be used to clock the register, the register latching is 
accomplished prior to the clock signal associated with the operand decode logic. Hence, 

20 the operand decode logic is not "left waiting" for the latching of the register 924. 

In one exemplary design of the ARC™ core incorporating the bypass logic 
functionality of the invention as described above with respect to Fig. 9, the decode logic 
900 and functional units 904, 906 are constrained to be minimized simultaneously. This 
constraint during design synthesis advantageously produces one fewer level of gate delay 

25 in the datapath as compared to the design resulting if such constraint is not imposed, 
thereby further enhancing pipeline performance. It will be appreciated that this 
refinement is not neceaasry to practice the essence of the invention, but serves to further 
the perfi"omance enhancement of the invention. 

The results of the previous operation (specifically, in the forgoing sum-of- 

30 products example, the sum firom a given iteration) are provided to the multi-function 
register 924 which in tum provides the sum value directly to the input of the bypass 
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operand selection logic 902. In this fashion, the bypass operand selection logic 902 is not 
required to access a memory location or another register repeatedly to provide the 
operands for the summation operation. 

It is also noted that the present invention may advantageously be implemented 
5 "incrementally" by moving lesser amounts of the bypass logic to the execution stage 
(e.g., stage 3). For example, rather than moving all bypass logic to stage 3 as described 
above, only the logic associated with bypassing of late arriving results of functional units 
can be moved to stage 3. It will be appreciated that differing amounts of logic 
optimization will be obtained based on the amount of bypass logic moved to stage 3. 
10 In addition to the structural improvement in performance as previously described 

(i.e., obviating memory/register accesses during each iteration of multi-cycle instructions, 
thereby substantially reducing the total number of memory/register accesses performed 
% during any given iterative calculation), there are several additional benefits provided by 

p employing the bypass logic arrangement of the present invention. One such benefit is that 

IJ 15 by removing the interposed register between the bypass operand selection and the 
functional units (shown in Fig. 2), design compilers can better optimize the generated 
logic to maximize speed and/or minimize the number of gates in the design. Specifically, 
the design compiler does not have to consider and account for the presence of the register 
interposed between the bypass operand selection logic and the single/multi-cycle 
20 functional imits. 

Another benefit is that by grouping the registers and logic in the improved fashion 
of Fig. 9, the bypass function is better isolated from the rest of the design. This makes 
VHDL simulations potentially execute faster and simplifies fault analysis and coverage. 
In sum, two primary benefits are derived from the improved bypass logic design 
25 described above. The first benefit is the ability to manage late arriving results from the 
functional units more efficiently. The second benefit is that there is better logic 
optimization within the device. 

The first benefit may be obtained by only moving the minimum required portion 
of the logic to the improved location. The second benefit may be attained in varying 
30 degrees by the amount of logic that is moved to the new location. This second benefit 
derives at least in part from the synthesis engine's improved ability to optimize the 
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results. The ability to optimize the results stems from the way in which the exemplary 
synthesis engine functions. In specific, synthesis engines generally treat all logic between 
registers as a single block to be optimized. Blocks that are divided by registers are 
optimized only to the registers. By moving the operand selection logic so that no registers 
5 are interposed between it and the functional unit logic, the synthesis engine can perform a 
greater degree of optimization. 

More detail on the design synthesis process incorporating the bypass logic of the 
present invention is provided herein with respect to Fig. 13. 

Referring now to Fig. 10, a method for operating the pipeline of a pipelined 
10 processor which facilitates the bypass of various components and registers so as to 
maximize processor performance during iterative operations (e.g., sum of products) is 
disclosed. The first step 1002 of the method 1000 comprises providing a multi-function 
^% register 914 such as that described with respect to Fig. 9 above. This register is defined 

w in step 1004 to include a "bypass mode", wherein during such bypass mode the register 

15 maintains the result of a multi-cycle scalar operation therein. In this fashion, the bypass 
operand selection logic 902 is not required to access memory or another location to 
ill obtain the operand (e.g.. Sum value) used in the iterative calculation as in prior art 

architectures. Rather, the operand is stored by the register 914 for at least a part of one 
^ cycle, and provided directly to the bypass operand selection logic using decode 

ill 20 information from the instruction to select register 914 directly without the need for any 
yj address generation. This type of register access differs from the general purpose register 

access present in RISC CPUs in that no address generation is required. General purpose 
register access requires register specification and/or address generation which consumes a 
portion of an instruction cycle and requires the use of the address generation resource of 
25 the CPU, The register employed in the bypass logic is an "implied" register that is 
specified by the instruction being executed without the need for a separate register 
specification. For certain instructions the registers of the datapath may function the same 
as an accumulator or other register. The value stored in the datapath register is transferred 
to a general purpose register during a later phase of the pipeline operation. In the 
30 meantime, iteration or other operations continue to be processed at full speed. 
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Next, in step 1006, a multi-cycle scalar operation is performed by the processor a 
first time. In the foregoing example of the sum-of-products calculation, such an operation 
comprises one iteration of the "Multiply" and "Sum" sub-operations, the result of the 
Sum sub-operation being provided back to the multi-function register 914 per step 1008 
5 for direct use in the next iteration of the calculation. 

In step 1010, the result of the previous iteration is provided directly from the 
register 914 to the bypass operand selection logic 902 via a bus element. 

Lastly, a second iteration of the operation is performed using the result of the first 
operation from the register 914, and another operand supplied by the address generation 
10 logic of the RISC CPU. The iterations are continued until the multi-cycle operation is 
completed (step 1011), and the program flow stopped or other wise continued (step 
1012). 

. s*- 

^^1 Data Cache Integration 

fji 15 Integration of the data cache can have a profound effect on the speed of the 

% processor. In general, the modified control of the data cache according to the present 

Ill invention is accomplished through data hazard control logic modifications. The following 

Q discussion describes several enhancements to the prior art data cache integration scheme 

^ of Fig. 3 made by the present invention, including (i) assumption of data cache "hit" 

1^1 20 unless a "miss" actually occurs; (ii) improved instruction request address generation; and 

(iii) relocation of bypass logic from stage 2 (decode) to stage 3 (execute). It should also 

be noted that some of these modifications provide other benefits in the operation of the 

core in addition to improved pipeline performance, such as lower operating power, 

reduced memory accesses, and improved memory performance. 
25 Referring now to Figs. 1 1 and 1 la, the improved data cache structure and method 

of the present invention is described in further detail. 

One embodiment of the improved data cache architecture is shown in Fig. 11, in 

the context of the multi-stage pipeline of the aforementioned ARC^^ RISC processor. 

The architecture 1 100 comprises a data cache 1 102, bypass operand selection logic 1 104 
30 (decode stage), result selection logic 1106 (2 logic levels), latch control logic 1108 (2 

levels), program counter (nextpc) address selection logic 1110 (2 levels), and cache 
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address selection logic 1112 (2 levels), each of the logic units 1106, 1108, 1112 
operatively supplying a third stage latch (register) 1116 disposed at the end of the second 
execution stage (E2) 1118. Summation logic 1111 is also provided which sums the 
outputs of the bypass operand selection logic 1104 prior to input to the multiplexers 
5 1 120, 1 122 in the data cache 1 102. 

In addition to the multiplexers 1120, 1122, the data cache 1102 comprises a 
plurality of data random access memory (RAM) devices 1126 (0 through w-1), further 
having two sets of associated tag RAMs 1 127 (0 through w-1) as shown. As used herein, 
the variable "w" represents the number of ways that a set associative cache may be 

10 searched. In general, w corresponds to the width of the memory array in multples of a 
word. For example, the memory may be two words wide (w=2) and the memory is then 
divided into two banks for access. The output of the data RAMs 1126 is multiplexed 
using a (w-1) channel multiplexer 1131 to the input of the byte/word/long word 
extraction logic 1132, the output of which is the load value 1134 provided to the result 

15 selection logic 1106. The output of each of the tag RAMs 1 127 is logically ORed with 
the output of the summation logic 1111 in each of the 0 through w-1 memory units 1138. 
The outputs of the memory units 1138 are input in parallel to a logical "OR" function 
1139 which determines the value of the load valid (Idvalid) signal 1140, the latter being 
input to the latch control logic 1 108 prior to the third stage latch 1116. 

20 In comparison to the prior art arrangement of Fig. 3 previously described, the 

present embodiment has relocated the bypass operand selection logic from the decode 
stage (and E2 stage) of the pipeline to the first execute stage (El) as shovm in Fig. 11. 
Additionally, the nextpc address selection logic 1110 receives the load value immediately 
after the data cache multiplexer 1131, as opposed to receiving the load value after the 

25 results selection logic as in Fig. 3. The valid signal for retuming loads (Idvalid) 1140 is 
also routed directly to the two-level latch control logic 1108, versus to the pipeline 
control and hazard detection logic as in Fig. 3. 

The foregoing modifications provide the following functionality: 

(i) Assumption of data cache "hit" - In contrast to the prior art approach of Figs. 3 
30 and 3a, the Idvalid signal 1140 does not influence pipeline movement in the present 
invention, since it is decoupled firom the control logic and hazard detection logic. Rather, 
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it is assumed that the data cache will "hit", and therefore the pipeline will continue to 
move. If this assumption is wrong, and the requested dataword is needed by an execution 
unit in the execution stage (El or E2), the pipeline is stalled at that point When the data 
cache 1102 makes the dataword available to the execution unit in need thereof, the 
5 operand for the instruction in the decode stage is updated. 

(ii) Instruction Request Address Generation - Word or byte extracted load results 
do not usually generate the instruction request address for a jump register indirect 
instruction (e.g., j [rx]). Therefore, as part of the present invention, the instruction request 
address is generated earlier by the next address selection logic of figure 11, and a jump 
10 register indirect address where the register value is bypassed from a load byte or word 
causes a structural pipeline stall. 

% (iii) Relocation of Bypass Logic - As illustrated in Fig. 1 1, the present invention 

J also relocates the bypass operand selection logic from stage 2 (decode) to stage 3 

fl (execute El), and from execute E2 to El, to allow the multi-cycle/multi-stage fimctional 

% 1 5 units cache extra time on all cycles but the first. 

Fig. 11a graphically illustrates the movement of the pipeUne of an exeplary 
processor configured v^th the data cache integration improvements of the present invention, 
y Note that the un-dashed bypass arrow 1 170 indicates prior art bypass logic operation, while 

2J the dashed bypass arrow 1172 indicates bypass logic if it is moved from stage 2 to 3 

Sir 

20 according to the present invention. The following provides and explanation of the operation 
of the data cache of Fig. 11a. 

In step 1 174, a load (Ld) is requested. Next, a Mov is requested per step 1 176. An 
Add is then requested per step 1178. In step 1180, the Ld begins to execute. In step 1182, 
the Mov begins to execute, and the cache misses. The Mov operation moves through the 

25 pipeline per step 1 184. The Add operation stalls in execute stage El, since the cache missed 
and the Add is dependent on the cache result. The cache then returns the Load Result Value 
per step 1 1 86, and the Add is computed per step 1188. The Add moves through the pipeline 
per step 1 190, the Add result is written back per step 1 192. 
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As illustrated in Fig. 11a, the improved method of data cache integration of the 
present invention reduces the number of stalls encountered, as well as the impact of a cache 
"miss" (i.e., condition where the instruction is not cached in time) during the execution of 
the program. The present invention results in the add instruction continuing to move through 
5 the pipeline until reference T saving instruction cycles. Further, by delaying pipeline stalls, 
the overall performance of the processor is increased. 



Method of Enhancing Performance of Processor Design 

Referring now to Fig. 12, a method of enhancing the performance of a digital 
10 processor design such as the extensible ARC^^ of the Assignee hereof is described. As 
illustrated in Fig. 12, the method generally comprises first providing a processor design 
which is non-optimized (step 1202), including inter alia critical path signals which 
uimecessarily delay the operation of the pipeline of the design. For example, the non- 
optimized prior art pipeline(s) of Figs. 1 through 4a comprises such designs, although 
15 others may clearly be substituted. In the present embodiment of the method, the processor 
design further includes an instruction set having at least one breakpoint instruction, for 
' reasons discussed in greater detail below. 

3 Next, in step 1204, a program comprising a sequence of at least a portion of the 

il processor's instruction set (including for example the aforementioned breakpoint 

20 instruction) is generated. The breakpoint instruction may be coded within a delay slot as 
previously described with respect to Fig. 8a herein, or otherwise. 

Next, in step 1206, a critical path signal within the processing of program within 
the pipeline is identified. In the illustrated embodiment, the critical path is associated 
with the decode and processing of the breakpoint instruction. The critical path is 
25 identified through use of a simulation running a simulation program such as the 
"Viewsim™" program manufactured by Viewlogic Corporation, or other similar 
software. Fig. 4a illustrates the presence of a critical path signal in the dataword address 
(e.g., nextpc) generation logic of a typical processor pipeline. 

Next, in step 1208 the architecture of the pipeline logic is modified to remove or 
30 mitigate the delay effects of the non-optimized pipeline logic architecture. In the 
illustrated embodiment, this modification comprises (i) relocating the instruction decode 
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logic to the second (decode) stage of the pipeline as previously described with reference 
to Fig. 8, and (ii) including logic which resets the program counter (pc) to the breakpoint 
address, as previously described. 

The simulation is next re-run (step 1210) with the modified pipeline configuration 
5 to verify the operability of the modified pipeline, and also determine the impact (if any) 
on pipeline operation speed. The design is then re-synthesized (step 1212) based on the 
foregoing pipeline modifications. The foregoing steps (i.e., steps 1206, 1208, 1210, and 
1212, or subsets thereof) are optionally re-performed by the designer (step 1214) to 
further refine and improve the speed of the pipeline, or to optimize for other core 
10 parameters. 



Method of Synthesizing 

;5f Referring now to Fig. 13, the method 1300 of synthesizing logic incorporating the 

^ti long instruction word functionality previously discussed is described. The generalized 

[i| 15 method of synthesizing integrated circuit logic having a user-customized (i.e., "soft") 
'^J instruction set is disclosed in Applicant's co-pending U.S. Patent Application Serial No. 

09/418,663 entitled "Method And Apparatus For Managing The Configuration And 
Q Fvinctionality Of A Semiconductor Design" filed October 14, 1999, which is incorporated 

j^f herein by reference in its entirety. 

vfy 20 While the following description is presented in terms of an algorithm or computer 

program running on a microcomputer or other similar processing device, it can be 
appreciated that other hardware environments (including minicomputers, workstations, 
networked computers, "supercomputers", and mainframes) may be used to practice the 
method. Additionally, one or more portions of the computer program may be embodied 

25 in hardware or firmware as opposed to software if desired, such alternate embodiments 
being well within the skill of the computer artisan. 

Initially, user input is obtained regarding the design configuration in the first step 
1302. Specifically, desired modules or functions for the design are selected by the user, and 
instructions relating to the design are added, subtracted, or generated as necessary. For 

30 example, in signal processing applications, it is often advantageous for CPUs to include a 
single "multiply and accumulate" (MAC) instruction. In the present invention, the 
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instruction set of the synthesized design is further modified so as to incorporate the desired 
aspects of pipeline performance enhancement (e.g. "atomic" instruction word) therein. 

The technology library location for each VHDL file is also defmed by the user in 
step 1302. The technology library files in the present invention store all of the information 
5 related to cells necessary for the synthesis process, including for example logical fiinction, 
input/output timing, and any associated constraints. In the present invention, each user can 
define his/her own library name and location(s), thereby adding further flexibility. 

Next, in step 1303, the user creates customized HDL fiinctional blocks based on the 
user*s input and the existing library of fiinctions specified in step 1302. 
10 In step 1304, the design hierarchy is determined based on user input and the 

aforementioned library files. A hierarchy file, new library file, and makefile are 
subsequently generated based on the design hierarchy. The term "makefile" as used herein 
refers to the commonly used UNIX makefile function or similar function of a computer 
^ system well known to those of skill in the computer programming arts. The makefile 

1 5 fiinction causes other programs or algorithms resident in the computer system to be executed 
in the specified order. In addition, it further specifies the names or locations of data files and 
tf^ Other information necessary to the successful operation of the specified programs. It is 

i^l noted, however, that the invention disclosed herein may utilize file structures other than the 

% "makefile" type to produce the desired functionality. 

^1 20 In one embodiment of the makefile generation process of the present invention, 

y[ the user is interactively asked via display prompts to input information relating to the 

desired design such as the type of "build" (e.g., overall device or system configuration), 
width of the external memory system data bus, different types of extensions, cache 
type/size, etc. Many other configurations and sources of input information may be used, 
25 however, consistent with the invention. 

In step 1306, the user runs the makefile generated in step 1304 to create the 
structural HDL. This structural HDL ties the discrete functional block in the design 
together so as to make a complete design. 

Next, in step 1308, the script generated in step 1306 is run to create a makefile for 
30 the simulator. The user also runs the script to generate a synthesis script in step 1308. 
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At this point in the program, a decision is made whether to synthesize or simulate 
the design (step 1310). If simulation is chosen, the user runs the simulation using the 
generated design and simulation makefile (and user program) in step 1312. Altematively, 
if synthesis is chosen, the user runs the synthesis using the synthesis script(s) and 
5 generated design in step 1314. After completion of the synthesis/simulation scripts, the 
adequacy of the design is evaluated in step 1316. For example, a synthesis engine may 
create a specific physical layout of the design that meets the performance criteria of the 
overall design process yet does not meet the die size requirements. In this case, the 
designer will make changes to the control files, libraries, or other elements that can affect 
10 the die size. The resulting set of design information is then used to re-run the synthesis 
script. 

If the generated design is acceptable, the design process is completed. If the 
design is not acceptable, the process steps beginning with step 1302 are re-performed 

"sir 

^ until an acceptable design is achieved. In this fashion, the method 1300 is iterative, 

ry 15 Fig. 14 illustrates an exemplary pipelined processor fabricated using a 1.0 um 

process. As shown in Fig. 14, the processor 1400 is an ARC™ microprocessor-like CPU 
device having, inter alia, a processor core 1402, on-chip memory 1404, and an external 
Q interface 1406. The device is fabricated using the customized VHDL design obtained 

Jj; using the method 1300 of the present invention, which is subsequently synthesized into a 

20 logic level representation, and then reduced to a physical device using compilation, 
layout and fabrication techniques well known in the semiconductor arts. For example, the 
present invention is compatible with 0.35, 0.18, and 0.1 micron processes, and ultimately 
may be applied to processes of even smaller or other resolution. An exemplary process 
for fabrication of the device is the 0.1 micron "Blue Logic" Cu-11 process offered by 
25 International Business Machines Corporation, although others may be used. 

It will be appreciated by one skilled in the art that the processor of Figure 14 may 
contain any commonly available peripheral such as serial communications devices, 
parallel ports, timers, counters, high current drivers, analog to digital (A/D) converters, 
digital to analog converters (D/A), interrupt processors, LCD drivers, memories and other 
30 similar devices. Further, the processor may also include custom or application specific 
circuitry, including an RF transceiver and modulator (e.g., Bluetooth^"^ compliant 2.4 
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GHz transceiver/modulator), such as to form a system on a chip (SoC) device useful for 
providing a number of different functionaUties in a single package. The present invention 
is not limited to the type, number or complexity of peripherals and other circuitry that 
may be combined using the method and apparatus. Rather, any limitations are imposed 
5 by the physical capacity of the extant semiconductor processes which improve over time. 
Therefore it is anticipated that the complexity and degree of integration possible 
employing the present invention will further increase as semiconductor processes 
improve. 

It is also noted that many IC designs currently use a microprocessor core and a 

10 DSP core. The DSP however, might only be required for a limited number of DSP 
functions, or for the IC's fast DMA architecture. The invention disclosed herein can 
support many DSP instruction functions, and its fast local RAM system gives immediate 
access to data. Appreciable cost savings may be realized by using the methods disclosed 
herein for both the CPU & DSP functions of the IC. 

15 Additionally, it will be noted that the methodology (and associated computer 

program) as previously described herein can readily be adapted to newer manufacturing 
technologies, such as 0.18 or 0.1 micron processes (e.g. "Blue Logic™" Cu-11 process 
offered by IBM Corporation), with a comparatively simple re-synthesis instead of the 
lengthy and expensive process typically required to adapt such technologies using "hard" 

20 macro prior art systems. 

Referring now to Fig. 15, one embodiment of a computing device capable of 
synthesizing logic structures capable of implementing the pipeline performance 
enhancement methods discussed previously herein is described. The computing device 
1500 comprises a motherboard 1501 having a central processing xmit (CPU) 1502, 

25 random access memory (RAM) 1504, and memory controller 1505. A storage device 
1506 (such as a hard disk drive or CD-ROM), input device 1507 (such as a keyboard or 
mouse), and display device 1508 (such as a CRT, plasma, or TFT display), as well as 
buses necessary to support the operation of the host and peripheral components, are also 
provided. The aforementioned VHDL descriptions and synthesis engine are stored in the 

30 form of an object code representation of a computer program in the RAM 1504 and/or 
storage device 1506 for use by the CPU 1502 during design synthesis, the latter being 
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well known in the computing arts. The user (not shown) synthesizes logic designs by 
inputting design configuration specifications into the synthesis program via the program 
displays and the input device 1507 during system operation. Synthesized designs 
generated by the program are stored in the storage device 1506 for later retrieval, 
displayed on the graphic display device 1508, or output to an external device such as a 
printer, data storage unit, fabrication system, other peripheral component via a serial or 
parallel port 1512 if desired. 

It will be recognized that while certain aspects of the invention are described in 
terms of a specific sequence of steps of a method, these descriptions are only illustrative 
of the broader methods of the invention, and may be modified as required by the 
particular application. Certain steps may be rendered unnecessary or optional under 
certain circumstances. Additionally, certain steps or functionality may be added to the 
disclosed embodiments, or the order of performance of two or more steps permuted. All 
such variations are considered to be encompassed within the invention disclosed and 
claimed herein. 

While the above detailed description has shown, described, and pointed out novel 
features of the invention as applied to various embodiments, it will be understood that 
various omissions, substitutions, and changes in the form and details of the device or 
process illustrated may be made by those skilled in the art without departing fi*om the 
invention. The foregoing description is of the best mode presently contemplated of 
carrying out the invention. This description is in no way meant to be limiting, but rather 
should be taken as illustrative of the general principles of the invention. The scope of the 
invention should be determined with reference to the claims. 
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